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DISTRIBUTED SOURCE LEARNING FOR DATA 
COMMUNICATION SWITCH 

FIELD OF THE INVENTION 

The present invention relates to devices for source learning and, more particularly, 
to devices for distributed source learning in a data communication switch. 



BACKGROUND OF THE INVENTION 

Data communication sv^itches interconnect network devices residing in different 
network domains. Such sv^itches typically include a plurality of sv^itching modules for 
sv^itching data traffic between external network devices and a centralized management 
module for configuring the switching modules. Part of the switching module 
configuration is "source learning." Source leaming is the process of dynamically 
learning associations between ports and the addresses of network devices they support by 
reviewing source addresses in inbound packets. By making such address-port 
associations, packets can be advantageously forwarded only on the ports of the switch 
supporting packet destinations rather than being "flooded" on all ports. 

In a conventional source leaming process, source addresses in packets are 
reviewed by a switching module upon ingress and unknown source addresses are 
submitted to the source leaming function resident on a centralized management module 
for processing. The management module configures the address-port association on the 
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switching modules such that future inbound packets destined to that address can be 
forwarded without unnecessary flooding. 

While the source learning process has resuUed in bandwidth savings in the form 
of reduced flooding, such savings have come at a price. Reliance on a centralized 
5 management entity for source learning has required a special internal protocol for 
flagging packets requiring source learning for capture by the management entity and has 
caused bottlenecks at the management module when many packets requiring source 
learning arrive at different switching modules within a short period of time. 

10 SUMMARY OF THE INVENTION 

The invention provides an efficient method and apparatus for accomplishing 
source learning in a data switch of the type having a plurality of switching modules, each 
supporting one or more external network devices and a backplane interconnecting the 
;=0 switching modules. Each switching module has logic resident thereon for performing 

^i^: 15 distributed source learning, including configuring xmknown source addresses "seen" in 
inbound packets and for making available or notifying the other switching modules that 
such source addresses were "seen" on a port thereof Address-port associations are 
thereby configured on the switch using distributed logic, i.e. without intervention by a 
centralized management entity. Packets having unknown source addresses are replicated 
20 at the first switching module to enable packet forwarding across the backplane to proceed 
in parallel with source learning. Exchange of source learning information between 
switching modules is made "out of band" on a bus interconnecting the switching 
modules. Packets having unknown destination addresses are replicated at the first 
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switching module where one copy is sent to a multicast queue for transmission and 
another copy is sent to a software module to find the destination address. Once the 
destination address is found, the multicast flow is interrupted, data is buffered for a period 
of time to ensure flow integrity (by keeping packets in correct order), and then the data 
5 flow is continued to a unicast queue for transmission. 

These and other aspects of the invention can be understood by reference to the 
following detailed description, taken in conjimction with the accompanying drawings, 
which are briefly described below. 

1 0 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a diagram of an exemplary data communication switch; 
Figure 2 is a diagram of an exemplary switching module within the data 
communication switch of Figure 1; 

Figure 3 is a flow diagram illustrating a source and destination indexing protocol 
15 for a known source and known destination according to Figure 2; 

Figure 4 is a flow diagram illustrating a source and destination indexing protocol 
for an unknown source and known destination according to Figure 2; 

Figure 5 is a flow diagram illustrating a source and destination indexing protocol 
for an unknown source and unknown destination and known source and unknown 
20 destination according to Figure 2; 

Figure 6 is a flow diagram illustrating the source learning protocol acquiring the 
destination address according to Figure 2; and 
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Figure 7 is a flow diagram illustrating the source learning protocol associating the 
source address with a port. 

DETAILED DESCRIPTION 
5 Figure 1 illustrates switch 100 in one embodiment of the present invention. 

Switch 100 includes switching backplane 102 driven by switching modules 104, 106, and 
108, where switching module 104 is coupled to host device 110, switching module 106 is 
coupled to host device 112, and switching module 108 is coupled to host device 114. 
Additionally, switching modules 104 and 106 are coupled to each other by control path 

10 116 and switching modules 106 and 108 are coupled to each other by control path 118. 
Each modulel04, 106, and 108 interfaces with backplane 102 over data path 120, 122, 
and 124, respectively, to transmit packet data to backplane 102 and receive packet data 
from the backplane 102. For example, host device 110 preferably determines whether a 
destination device is on the same IP or IPX network by comparing its layer 3 addresses to 

15 the destination layer 3 address. If the destination address comparison indicates that the 
destination device is on the same network, an Address Resolution Protocol (ARP) 
message is sent from host 110 to retrieve the layer 2 address of the destination, and 
bridging is used to transmit the packet data. If the destination device is not on the same 
network, an ARP message is sent to retrieve the layer 2 default Media Access Control 

20 (MAC) address of the first router which will lead to the destination device, and routing is 
used to transmit the packet data. In the latter case, while the layer 2 default MAC address 
constantly changes to reflect the next router address leading to the destination device, the 
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layer 3 IP destination address preferably stays constant to reflect where the packet is 
going. 

Figure 2 is a block diagram of switching module 200, which may be similar to 
switching module 104 of FIG. 1. Switching module 200 preferably has a source learning 

5 capabihty, which will be described in reference to Figure 2. Module 200 includes access 
controller 202 coupled to switching controller 204. Access controller 202 receives 
packets from host devices, operates on them, and transmits them to switching controller 
204. Access controller 202 also receives packets from switching controller 204, operates 
on them, and transmits them to host devices. Switching controller 204 is not only coupled 

10 to access controller 202 but is coupled to queue controller 206 as well. Switching 
controller 204, similar to access controller 202, receives packets from access controller 
202, processes them, and transmits them to queue controller 206. Switching controller 
204 also receives packets from queue controller 206, processes them, and transmits them 
to access controller 202. Queue controller 206 includes unicast packet buffer (UPB) 218, 



15 multicast packet buffer (MPB) 220 and lock table 222. Queue controller 206 is coupled 
to many elements, including source address resolution element (SARE) 208, destination 
address resolution element (DARE) 210, unicast queue 212, multicast queue 214, queue 
identification (QID) 216, and source learning element 224 (where source learning 
element 224 is coupled to software table 226 and pseudoCAM (PCAM) 228, which may 

20 be implemented in hardware, software, or both). 

Queue controller 206 preferably receives a data packet from switching controller 
204, SARE 208 determines whether the source address is known for the packet, DARE 
210 determines whether the destination address is known for the packet, and QID 216 
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assigns a port number, priority, and bandwidth to the packet. Then, queue controller 206 



stores the packet in unicast queue 212 or multicast queue 214 to be transmitted when its 
priority for the particular port is reached. 
Source and Destination Conditions: 

One embodiment of the present invention is a novel source learning techniique 
using multiple switching modules coupled together on a single backplane. The single 
backplane architecture preferably allows for source learning and transmitting 
determinations to be made for packets having different source and destination conditions 
in a single path. Packets with a known source address and a known destination address 
preferably are not sent to a source learning element and are transmitted to a unicast queue 
for transmission and forwarding. Packets with an unknown source address and a kno^yn 
destination address preferably are sent to the source learning element for source learning 
and concurrently transmitted to a unicast queue for transmission and forwarding. Packets 
with a known source address and an unknown destination address preferably are not sent 
to the source leaming element and are transmitted to a multicast queue for transmission 
and forwarding. Packets with an unknown source and an unknown destination 
preferably are sent to the source leaming element for source leaming and concurrently 
transmitted to a multicast queue for transmission and forwarding. 

Therefore, the source leaming technique in this embodiment preferably processes 
the following four categories of packets in a single flow path: (1) known source address 
and known destination address; (2) unknown source address and known destination 
address; (3) known source address and xmknown destination address; and (4) unknown 
source address and unknown destination address. In the case where the destination 
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address is known, flow integrity typically is not an issue since the unicast queue normally 
is the only queue being used. In other embodiments, the source learning technique may 
use more than one flow path to process the four categories of packets. 
Known Source and Known Destination: 
5 Referring to Figure 3, a packet is received at queue controller 206 (302) from 

switching controller 204. Upon receiving the packet, a lookup operation is performed to 
determine the source address in SARE 208 (304). If the source address is not found 
(306), the packet is tagged for source learning in source learning element 224 (308). If 
the source address is found (306), a lookup operation is performed to determine the 

10 destination address in DARE 210 (310). If the destination address is not found (312), the 
packet is defined for flooding (314) and source leaming element 224 is notified (316) so 
that it can search for the destination address in the switching modules. If the destination 
address is found (312), as is the case here, the packet may follow one of the following 
three paths depending on the state of the destination address: last multicast packet path, 

15 first unicast packet path, and neither last multicast nor first unicast packet path. These 
paths ensure flow integrity for the packets. As a result, all multicast packets preferably 
are transmitted to this destination address before any unicast packets are transmitted 
there. 

Last Multicast Packet Path: 
20 Once the packet is found to have both its source and destination addresses 

associated with a port, queue controller 206 preferably performs a check to see if the flow 
state is marked as the last multicast packet (318). If the flow state is marked as the last 
multicast packet, thus indicating that the packet is defined for flooding (320), a lock bit is 
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set in multicast packet buffer (MPB) 220 (322) internal to queue controller 206, and the 
flow state is changed from "last multicast packet" to "first unicast packet" (324). In such 
state, the packet is still flooded. Thus, referring to Figure 5, QID 216 preferably defines 
the port for flooding and subsequently finds the priority and bandwidth to be applied to 
5 the packet (502). Additionally, to ensure that all multicast packets are transmitted to this 
destination address before any unicast packets are transmitted there, a lock bit in lock 
table 222 internal to queue controller 206 is set (504) when the lock bit is set in MPB 220 
(506). If the lock bit is not set in MPB 220, the lock bit is not set in lock table 222 (506). 
In either case, the packet is thereafter stored in multicast queue 214 until the bandwidth is 
10 available at the specified priority for the port (508). Once bandwidth is available at the 



specified priority for the port, the packet is transmitted (510), the lock bit is cleared in 
lock table 222 (510) and the packet is tested to see if the source address is knovra (512). 
In this case, nothing more is done since the source address is known (514). If the source 
address were unknown, the packet would be sent to source learning element 224 (516). 



Referring to Figure 3, if the flow state is not marked as the last multicast packet 
(318), a test is performed to see if the flow state is marked as the first unicast packet 
(326). If, as in this case, the flow state is marked as the first unicast packet, a lock bit is 
set in a unicast packet buffer (UPB) 218 (328). Next, QID 216 preferably defines the port, 
20 priority, and bandwidth for the packet (330) and the packet is stored in unicast queue 212 
until bandwidth is available at the specified priority for the port (332). Once bandwidth 
is available at the specified priority for the port, a check preferably is performed to see if 
the lock bit in UPB 218 is clear (334). If the lock bit in UPB 218 is clear, the packet is 

261795-3 8 



15 



First Unicast Packet Path: 



X2/DAC/39981 




134/017 



transmitted (336). As is the case here, the lock bit in the UPB 218 is set, and 
consequently, a test is performed to see if the lock bit in lock table 222 is clear (338). If 
the lock bit in lock table 222 is clear, the packet is transmitted (336). If the lock bit in 
lock table 222 is not clear, the packet is buffered until it is cleared by the transmission of 
5 the last multicast packet (340). Once the last multicast packet has been transmitted, then 
this packet is transmitted (336). 

Neither Last Multicast nor First Unicast Packet Path: 

Referring to Figure 3, if the flow state is not marked as a last multicast packet or 
first unicast packet, the packet is forwarded to QID 216 so that the port, priority, and 



10 bandwidth can be defined for the packet (330) and the packet will be stored in unicast 
queue 212 until bandwidth is available at the specified priority for the port (332). Once 
bandwidth is available at the specified priority for the port, a check preferably is 



performed to see if the lock bit in UPB 218 is clear (334). If the lock bit in UPB 218 is 
clear, as is the case here, the packet is transmitted (336). If the lock bit in the UPB 218 is 



15 set, a test is performed to see if the lock bit in lock table 222 is clear (338). Ifthe lock bit 
in lock table 222 is clear, the packet is transmitted (336). If the lock bit in lock table 222 
is not clear, the packet is buffered until the lock bit in lock table 222 is cleared by the 
transmission of the last multicast packet (340). Once the last multicast packet has been 
transmitted, then this packet is transmitted (336). 

20 Unknown Source and Known Destination: 

Referring to Figure 3, a packet is received at queue controller 206 (302) fi'om 
switching controller 204. Upon receiving the packet, a lookup operation is performed to 
determine the source address in SARE 208 (304). If the source address is found (306), a 
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lookup operation is performed to find the destination address (310). If the source address 
is not found (306), as is the case here, the packet is tagged for source learning in source 
learning element 224 (308). Referring to Figure 4, after the packet is tagged for source 
leaming (308), it is fiirther processed so that a destination lookup (402) can be performed 
5 in DARE 210. If the destination address is not found (404), the packet is defined for 
flooding (406) and source leaming 224 is notified so that it can search for the destination 
address (408). If the destination address is found, which is the case here, the packet may 
follow one of the following three paths depending on the state of the destination address: 
last multicast packet path, first unicast packet path, and neither last multicast nor first 



10 unicast packet path. These paths ensure flow integrity for the packets. As a result, all 
multicast packets preferably are transmitted to this destination address before any unicast 
packets. 



15 destination address, queue controller 206 preferably performs a check to see if the flow 
state is marked as the last multicast packet (410). If the flow state is marked as the last 
multicast packet, thus indicating that the packet is defined for flooding (412), a lock bit is 
set in MPB 220 (414) intemal to queue controller 206 and the flow state is changed fi-om 
last multicast packet to first unicast packet (416). In such state, the packet is still flooded. 



20 Thus, referring to Figure 5, QID 216 preferably defines the port for flooding and 
subsequently finds the priority and bandwidth to be applied to the packet (502). 
Additionally, to ensure that all multicast packets are transmitted to this destination 
address before any unicast packets are transmitted to this destination address, a lock bit in 



Last Multicast Packet Path: 



Once the packet is found to have an unknown source address and a known 
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lock table 222 internal to queue controller 206 is set (504) when the lock bit is set in 
MPB 220 (506). If the lock bit is not set in MPB 220, the lock bit is not set in lock table 
222 (506). In either case, the packet is thereafter stored in multicast queue 214 until 
bandwidth is available at the specified priority for the port (508). Once bandwidth is 
available at the specified priority for the port, the packet is transmitted (510), the lock bit 
is cleared in lock table 222 (510) and the packet is tested to see if the source address is 
known (512). In this case, the source address is unknown and the packet is sent to source 
learning 224 (516) so that its source address can be associated with its particular port. 
Referring to Figure 7, a request is received by source learning 224 to learn a source 
address (702). Upon processing the request, a layer 2 source MAC which relates to a port 
is stored in a software table 226 (704). This software table 226 may be used for many 
things, for example, source learning 224 may use it to inform its own and/or other 
switching modules of a new source address and/or source learning 224 may use it to 
allow access for its own and/or other modules to read and/or write to the software table 
226. Thereafter, source learning software in source learning element 224 will place the 
source MAC in a hardware table pseudo CAM 228 (706) and then will wait for another 
request to perform source learning. If the source address were known, the packet would 
not be sent to source learning element 224 (514) and nothing more would be done. 
First Unicast Packet Path: 

Referring to Figure 4, if the flow state is not marked as the last multicast packet 
(410), a test is performed to see if the flow state is marked as the first unicast packet 
(418). If, as in this case, the flow state is marked as the first unicast packet, the lock bit is 
set in UPB 218 (420). Next, QID 216 defines the port, priority, and bandwidth for the 
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packet (422) and the packet will be stored in tinicast queue -212 until bandwidth is 
available at the specified priority for the port (424). Once bandwidth is available at the 
specified priority for the port, a check preferably is performed to see if the lock bit in 
UPB 218 is clear (426). If the lock bit in UPB 218 is clear, the packet is transmitted 
5 (428) and sent to source learning element 224 (430). As is the case here, the lock bit in 
the UPB 218 is set, and consequently, a test is performed to see if the lock bit in lock 
table 222 is clear (432). If the lock bit in lock table 222 is clear, the packet is transmitted 
(428) and sent to source learning 224 (430). If the lock bit in lock table 222 is not clear, 
the packet is buffered imtil the lock bit in lock table 222 is cleared by the transmission of 



10 the last multicast packet (434). Once the last multicast packet has been transmitted, then 
this packet is transmitted (428) and sent to source learning element 224 (430). The 
packet is sent to source learning 224 (700) so that its source address can be associated 
with its particular port. Referring to Figure 7, a request is received by source learning 
224 to leam a source address (702). Upon processing the request, a layer 2 source MAC 



15 which relates to a port is stored in a software table 226 (704). This software table 226 
may be used for many things, for example, source learning 224 may use it to inform its 
own and/or other switching modules of a new source address and/or source learning 224 
may use it to allow access for its own and/or other modules to read and/or write to the 
software table 226. Thereafter, soiu-ce learning software in source learning element 224 

20 will place the source MAC in a hardware table pseudo CAM 228 (706) and then will wait 
for another request to perform source leaming. 



Neither Last Multicast nor First Unicast Packet Path: 
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Referring to Figure 4, if the flow state is not marked as a last multicast packet or 
first unicast packet, the packet preferably is forwarded to QID 216 so that the port, 
priority, and bandwidth can be defined for the packet (422) and the packet is stored in 
unicast queue 212 until bandwidth is available at the specified priority for the port (424). 
Once bandwidth is available at the specified priority for the port, a check preferably is 
performed to see if the lock bit in UPB 218 is clear (426). If the lock bit in UPB 218 is 
clear, as is the case here, the packet is transmitted (428) and sent to source learning 
element 224 (430). If the lock bit in the UPB 218 is set, a test is performed to see if the 
lock bit in lock table 222 is clear (432). If the lock bit in lock table 222 is clear, the 
packet is transmitted (428) and sent to source learning element 224 (430). If the lock bit 
in lock table 222 is not clear, the packet is buffered until the lock bit in lock table 222 is 
cleared by the transmission of the last multicast packet (434). Once the last multicast 
packet has been transmitted, then this packet is transmitted (428) and sent to source 
learning element 224 (430). The packet is sent to source learning 224 (700) so that its 
source address can be associated with its particular port. Referring to Figure 7, a request 
is received by source learning 224 to learn a source address (702). Upon processing the 
request, a layer 2 source MAC which relates to a port is stored in a software table 226 
(704). This software table 226 may be used for many things, for example, source 
learning 224 may use it to inform its own and/or other switching modules of a new source 
address and/or source learning 224 may use it to allow access for its ovm and/or other 
modules to read and/or write to the software table 226. Thereafter, source leaming 
software in source leaming element 224 will place the source MAC in a hardware table 
pseudo CAM 228 (706) and then will wait for another request to perform source leaming. 
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Known Source and Unknown Destination: 

Referring to Figure 3, a packet is received at queue controller 206 (302). Upon 
receiving the packet, a lookup operation is performed to determine the source address 208 
(304). If the source address is not found (306), the packet is tagged for source learning in 
5 source learning element 224 (308). If the source address is found (306), as is the case 
here, a lookup operation is performed to determine the destination address in DARE 210 
(310). If the destination address is found (312), a check is performed to see if the flow 
state is marked as a last multicast packet (318). If the destination address is not found 
(312), as is the case here, the packet is defined for flooding (314) and source learning 
10 element 224 is notified so that it can search for the destination address in the switching 
fi modules (316). Referring to Figure 6, source learning element 224 receives a request to 

n 

n find the destination address (602). Once the request has been received, source learning 

element 224 uses its software to look in its own modules and others to find the 
^ destination address (604). If the destination address is not found (606), the flood of 

3 15 packets are allowed to continue (608), a request to find the destination is again received 
(602), the software is used to search for the destination address (604), and a test is 
performed to see if the destination address was found this time (606). This process 
preferably continues imtil the destination address is found. If the destination address is 
found, QID 216 defines a port, priority, and bandwidth for the packet (610), an entry is 
20 created in PCAM 228 for the new destination address (612), and the flow state is set to 
last multicast (614) so that the last remaining packet is transmitted to this destination over 
multicast queue 214 before the first unicast packet is transmitted to this destination over 
unicast queue 2122. 
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Referring to Figure 5, after the packet is defined for flooding (314) and source 
learning element 224 is notified so that it can search for the destination address in the 
switching modules (316), QID 216 defines the port for flooding and subsequently finds 
the priority and bandwidth to be applied to the packet (502). Additionally, to ensure that 
all multicast packets are transmitted to this destination address before any unicast packets 
are transmitted there, a lock bit in lock table 222 internal to queue controller 206 is set 
(504) when the lock bit is set in MPB 220 (506). If the lock bit is not set in MPB 220, 
then the lock bit in lock table 222 is not set (506). In either case, the packet is thereafter 
stored in a multicast queue 214 until bandwidth is available at the specified priority for 
the port (508). Once bandwidth is available at the specified priority for the port, the 
packet is transmitted (510), the lock bit is cleared in lock table 222 (510), and the packet 
is tested to see if the source address is knoAvn (512). In this case, the source address is 
known and nothing more is done (514). If the source address is unknown, the packet is 
sent to source learning element 224 (516) so that the source address can be associated 
with its particular port. 
Unknown Source and Unknown Destination: 

Referring to Figure 3, a packet is received at queue controller 206 (302). Upon 
receiving the packet, a lookup operation is performed to determine the source address 208 
(304). If the source address is found (306), a lookup operation is performed to determine 
the destination address (310). If the source address is not found (306), as is the case here, 
the packet is tagged for source learning in source learning element 224 (308). Referring 
to Figure 4, after the packet is tagged for source learning (308), it is fiirther processed so 
that a destination lookup (402) can be performed in DARE 210. If the destination is 
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found, the packet may follow one of three paths, depending on the state of the destination 
address. If the destination address is not found (404), as is the case here, the packet is 
defined for flooding (406) and source learning 224 is notified so that it can search for the 
destination address (408). Referring to Figure 6, source learning element 224 receives a 
5 request to find the destination address (602). Once received, source learning element 224 
uses its software to look in its own modules and others to find the destination address 
(604). If the destination address is not found (606), the flooding of packets is allowed to 
continue (608), a request to find the destination is again received (602), the software is 
used to search for the destination address (604), and a test is performed to see if the 

10 destination address was found this time (606). This process preferably continues until the 
destination address is found. If the destination address is found, QID 216 defines a port, 
priority, and bandwidth for the packet (610), an entry is created in PC AM 228 for the new 
destination address (612), and the flow state is set to last multicast (614) so that the last 
remaining packet is transmitted over multicast queue 214 before the first unicast packet is 

15 transmitted over unicast queue 212. Referring to Figure 5, after the packet is defined for 
flooding (314) and source learning element 224 is notified so that it can search for the 
destination address in the switching modules (316), QID 216 will define the port for flood 
and will subsequently find the priority and bandwidth to be applied to the packet (502). 
Additionally, to make sure all multicast packets are transmitted to this destination address 

20 before any unicast packets are transmitted to this destination address, a lock bit in lock 
table 222 internal to queue controller 206 is set (504) when the lock bit is set in MPB 220 
(506). If the lock bit is not set in MPB 220, then the lock bit in lock table 222 is not set 
(506). In either case, the packet is thereafter stored in a multicast queue 214 until 
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bandwidth is available at the specified priority for the port (508). Once bandwidth is 
available at the specified priority for the port, the packet is transmitted (510), the lock bit 
is cleared in lock table 222 (510), and the packet is tested to see if the source address is 
known (512). In this case, the source address is unknown and the packet is sent to source 
5 learning 224 (516) so that its source address can be associated with its particular port. 
Referring to Figure 7, a request is received by source learning 224 to learn a source 
address (702). Upon processing the request, a layer 2 som'ce MAC which relates to a port 
is stored in a software table 226 (704). This software table 226 may be used for many 
things, for example, source learning 224 may use it to inform its ov/n and/or other 

10 switching modules of a new source address and/or source learning 224 may use it to 
allow access for its own and/or other modules to read and/or vmte to the software table 
226. Thereafter, source learning sofl^vare in source learning element 224 will place the 
source MAC in a hardware table pseudo CAM 228 (706) and then will wait for another 
request to perform source learning. If the source address were known, the packet would 

15 not be sent to source learning element 224 (514) and nothing more would be done. 

It will be appreciated by those of ordinary skill in the art that the invention can be 
embodied in other specific forms without departing from the spirit or essential character 
hereof The present description is therefore considered in all respects to be illustrative 
and not restrictive. The scope of the invention is indicated by the appended claims, and - 

20 all changes that come within the meaning and range of equivalents thereof are intended to 
be embraced therein. 
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